ON THE STABILITY OF UTILITY MAXIMIZATION PROBLEMS 



ERHAN BAYRAKTAR AND ROSS KRAVITZ 

Abstract. In this paper we extend the stabihty results of [5]. Our utihty maximization problem is 
defined as an essential supremum of conditional expectations of the terminal values of wealth pro- 
cesses, conditioned on the filtration at the stopping time r. To establish these results, our principal 
contribution is an extension of the classical result of convex analysis that pointwise convergence 
of convex functions implies convergence of their derivatives. The notion of convex compactness 
introduced in [10] plays an important role in our analysis. 
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1. Introduction 

In this paper, we extend the results of jSj on the stabihty of the utihty maximization problem 
with respect to changes in the market paramaters. The main difference between our paper and 
theirs is that we work at arbitrary stopping times instead of only at the initial time t = 0. We give 
a direct extension of [5] , by specifiying when convergence of wealths and markets at a stopping time 
r give rise to convergent optimal terminal wealths and convergent value functions. Our results can 
also be used to treat the time zero case of [5] when the initial sigma algebra J-q is nontrivial. Along 
the way, we prove conditional versions of the convex duality of [1] ; parts of this theory have already 
been used, for example in [8], to prove time zero results. 

In [S], a basic methodology is established for proving continuity of utility maximization problems. 
First, one proves stability for the dual value problem, which is an optimization problem over the 
set of supermartingale deflators, the polar set of admissible wealth processes. Second, to show 
that there is a "continuous" connection between the dual and primal problems, one shows that the 
derivative of the dual value function is also stable with respect to perturbations of the market. 

In the time zero case, the second part of this program is trivial. Indeed, it is a classical result from 
convex analysis that pointwise convergence of convex functions implies locally uniform convergence, 
which in turn yields convergence of derivatives. Compactness plays a crucial role in establishing this 
theorem: essentially one uses an equicontinuity result and the existence of finite e-nets for compact 
sets. 

Working in a conditional framework, we are led unavoidably to mappings from to L^, where 
the topological structure is much less friendly. Due to the scarcity of compact sets in the infinite 
dimensional, non locally convex space L^, we are forced to work with the weaker concept of convexly 
compact sets, recently defined in [TO]. In this setting, we use two kinds of generalized e-nets, one 
each for upper and lower bounds, to establish uniform convergence of dual value functions on 
convexly compact sets. Here, we see that convexity alone is not enough, and we must use some 
additional structure of the dual value problem. 

As a corollary of our results, we can extract information about convergence of optimal wealth 
processes at intermediate times by exploiting a natural martingale property of optimal wealth 
processes. For example, suppose that we put ourselves in the exact framework of [5]. We have a 
sequence of positive initial wealths x„ converging to x, and a sequence of markets A„ converging 
in an appropriate sense to A. In [5], it is established that the optimal terminal wealths in each 
market, X^, converge in probability to Xt, the optimal terminal wealth in the market A. Using 
our results, we may establish the fact that for any stopping time r, the optimal wealths at time r, 
X", converge to Xr in probability. 

The rest of the paper is organized as follows: In the rest of Section [H we introduce the necessary 
financial framework for the problem, as well as highlighting the results of [S] and [3] on the stability 
problem and value function duality in general. Finally, we state our main results in the paper. In 
Section [21 we extend results of convex analysis from the real- valued case to functions from to 
L^, and establish the convex duality of [4J in this setting, before applying our abstract results to 
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the financial model. In Section [3l we prove that the dual value function is continuous with respect 
to dual wealth and market parameters. In Section [H we show that the derivatives of the value 
functions, suitably defined, are also continuous with respect to the market parameters. Finally, in 
Section [Sj we move from the dual problem to the primal one, and finish the proofs of our main 
theorems. In the appendix we establish a conditional version of the minimax theorem, which is 
used in Section 2. 

1.1. The Financial Framework. Let {Q, P, iJ^t)te[o,T]) be a filtered probability space satisfying 
the usual conditions. We assume that Tt = the global sigma algebra; if no specific sigma 
algebra is specified, L^, L^, L^, etc. will always refer to measurability with respect to J-. All 
random variables under consideration are at the least measurable with respect to J-". Statements 
concerning random variables are always understood to hold almost surely. Let M be a continuous 
local martingale, and let 

A = |a : A is a predictable process satisfying J A^(i[M]„ < oo | . 
For A G A, define 

rt 



S^ = l + Mt+ [ Xud[M]u. 
Jo 



Along with a numeraire bond, each defines a stock market. It is interpreted as the discounted 
price of an asset. Let A^ C A contain those A which define a market satisfying no free lunch with 
vanishing risk (NFLVR). According to the paper [1], the NFLVR condition is equivalent to the 
existence of a local martingale measure for S"^. Also, it is proven in [2] that all continuous market 
models satisfying NFLVR have the specific form described above. 

A trading strategy H is a predictable, S'-integrable process. We denote by Af^(x) the set of wealth 
processes attainable from initial capital x and subject to an admissibility constraint. Formally, 

X^{x) = {x + H ■ : H is predictable, S - integrable, and x + H ■ > 0}. 

We will simply write X"^ for 
For a given A € A, define 

= £{-\ ■ M)t = exp {- £ XudMu - ^ Xld[M]u^ . 

This is a strictly positive local martingale such that Z^'^X is a supermartingale for X E X^[x). 
Let y^{y) be the set of supermartingale defiators starting from y for the market described by A. 
Formally, 

3^'^(y) = • ^ is cadlag, adapted, positive, and XY is a supermartingale for all X S <Y^,5^o = v}- 

We denote by Y'^ the set {Yt : Y € y'^} of terminal values of supermartingale deflators. 
For T a stopping time, we denote by the set of supermartingale deflators starting at 1 for the 
market restricted to the (random) time interval [t, T]. Again, y^ refers to the terminal values of 
elements of 3^^. Furthermore, for t] G L1^(J>), i.e. r] strictly positive and Jv-measurable, y^{f]) 
are those supermartingale deflators for [r, T] which start at rj. Obviously, super martingales starting 
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at nonintegrable rj need not have finite expectation, so without further ado we relax this condition 
to require only that conditional expectations at time r be finite. We note that y^{y) = yy^ for 
y > 0. More generally, for rj G Ll__|_(Jv), we have yriv) = ''?3^t- the primal side, we define X^, 
x'l^ etc. accordingly. 

It is useful to consider the dual problem because the structure of y^ as a function of A is easy 
to understand. From Proposition 3.2 of [5], we have that all Y G 3^'*' such that > have the 
form Y = Z'^£{L)D, where L is a cadlag local martingale strongly orthogonal to M, and D is a. 
predictable, nonincr easing, cadlag process with Dq = 1 and > 0. The extension of this result 
to y^ is trivial, with the obvious small modifications. Furthermore, instead of considering £{L) 
as above, it is equivalent to simply consider a strictly positive cadlag local martingale L' which is 
strongly orthogonal to M. 

In light of the above description of y^^, we will sometimes find it useful to write = {Z'^yD : 
D as above }, where y is defined to be the set of strictly positive, cadlag local martingales which 
are strongly orthogonal to M, and starting from 1. The sets 3^t, 3^, and yt are defined in the same 
way as before. 

We will consider utility functions defined on the positive axis. We assume that U : M4. ^ M is 
C^, strictly concave, and satisfies the Inada conditions. Most importantly, U must have asymptotic 
elasticity strictly less than 1, as defined in [4J. This means 

AE{U) = hmsup —V < 1' 

x^oo U (X) 

and reflects the economic fact that the ratio of marginal utility to average utility should asymptot- 
ically become small. The classical primal utility maximization problem is given by 

u^{x) = sup E[UiXT)]. 

In the following sections, we will be concerned with an extension of this utility maximization from 
t = to [0, T]-valued stopping times. 

The convex conjugate of U is denoted by V, and is defined, for y > 0, by 

V{y) = sup {U{x) — xy). 

x>0 

From basic facts of convex analysis, we know that V is and strictly convex. Frequently, it will 
be convenient to decompose V = — V~ into its positive and negative parts. As a result of the 
asymptotic elasticity hypothesis on U, V has the following property: there is yo > such that for 
any fi G (0, 1), V{fj,y) < fi^°^V{y) for any y G (0, yo] and for some q > 0; see Lemma 6.3 of The 
classical dual utility minimization problem is given by 

v^{y) = inf E[V{Yt)]. 

YeY^{y) 

The fundamental result concerning the value functions Uq and Vq is provided by [4J. We cite the 
pertinent results here, suppressing A notation, because the results hold for a fixed market. 
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Proposition 1.1 ([4J). Assume that NFLVR is satisfied, the Inada conditions on U hold, that 
uq{x) < oo for some x > 0, and that the asymptotic elasticity ofU is less than 1. Then 

(a) uq{x) < oo for all x, VQ{y) < oo for all y. 

(b) The value functions uq and vq are convex conjugates. 

(c) The value functions uq and vq are continuously differentiahle on (0,oo). 

(d) The optimal solution Y{y) G y{y) to the dual optimization problem exists, and the optimal 
solution X{x) G X{x) to the primal optimization problem exists. For y = u'q{x), we have 
the dual relation Y{y)T = U'{X{x)t). 

1.2. Introduction to the Stability Problem. The following crucial definition is introduced in 
i5j. 

Definition 1.2. A set A' is V-relatively compact if \^V{Z^) : A G A'} is uniformly integrable. 

Definition 1.3. A topology % on K is called appropriate if the mapping (A, T) — >• LP{J-t) given 
by \^ is continuous with respect to convergence in probability. 

We have the following result from [5j: 

Proposition 1.4. Let A' be a V-relatively compact subset of Am, and let T be an appropriate 
topology on A. Then the mappings 

A' X (0, oo) 3 (A, x) ^ u^{x) G M 

and 

A' X (0, oo) B (A, x) ^ X^'^ G L° + 

are both jointly continuous. 

Throughout this paper, we will frequently posit the existence of a sequence (A^) C A' which is 
converging appropriately to some A G A'. For any A, we will denote by Xi^'^ the optimal terminal 
wealth in the agent's utility maximization problem. Y^'^ will denote the terminal value of the dual 
minimization problem for A. For conciseness, Xy'-^" will be shortened to X^'", and Y^'^" wih be 
shortened to y^'". 

To finish this section, we collect some known results from ||5| as well as some easy consequences. 
We work under the same assumptions made in Proposition ll.il 

Lemma 1.5. The set V~{y'^) is uniformly integrable. 

Proof. See [4J for details. The set 3^'^ is bounded in L^, and V~' is strictly concave. The assertion 
follows now from the de La Vallee-Poussin criterion for uniform integrability. □ 

A trivial consequence of Lemma [T3] is that, for yo > 0, the set {V^{yy''^) : y G [0,yo]} is also 
uniformly integrable. 

Lemma 1.6. For x > 0, the set I U~{X^'^) : A G A' > is uniformly integrable. 
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Proof. Write the duality relationship U{X^'^) = ViYj.'^) + X^^'^Yj,'^ , for y = {uq)'{x). The second 
term on the right hand side is nonnegative, so it follows that < U~{X^''^) < V~ {Y^''^). Now 
apply Lemma 11.51 to obtain the result. □ 

Again, we have a trivial extension of Lemma [l.6l to cases where x is allowed to vary in an interval 
bounded away from zero as opposed to being held fixed. Note that if X is a subinterval of M-|-+ 
bounded away from zero, then Uq(I) is bounded from above. 

Lemma 1.7. Let A„ — ?• A appropriately, and let Xn ^ x in M+. Then C/(X^"'") ^ U{X^'^) in L\ 

Proof. From Proposition 11.41 we have that X^"'" X^'"" in probability and that 
E[U{X^''^)]. Since U is continuous, so is U~ , and the first fact implies that C/~(X^"'") U~{X!^'^) 
in probability. Recall that convergence in probability plus uniform integrability is equivalent to 
convergence. Then Lemma [L6] implies that U-{X':^' ) in L^. 

It remains to treat the positive part. Note that ^[f7(X^"'")] E[U{Xi^'^)] and ?7"(X^"'") 
U-{X^'^) in imply that (X^"'")] E[U+{X^'^)]. Furthermore, we of course have that 

U~^{Xi^"'"') ) in probability. Note that in Scheffe's lemma, a.s. convergence can just as 

easily be replaced by convergence in probability. Thus, we have that [/"^(X^"'") — )• U"^{Xi^''^) in 
L^. Putting the positive and negative pieces together, we obtain the result. □ 

1.3. Main Financial Results. The principal aim of this paper is to extend the results of [5], valid 
at t = 0, to all stopping times valued in [0,T]. Let r be a stopping time, and let ^ € L^_^_{Tr) and 
ri € L° We set 

= esssup E[U{^X) \ JV], v^{r]) = essinf E[V{riY) \ Tr]. 

Theorem 1.8. Let A' be a V -relatively compact subset of A^, with an appropriate topology on A, 
and let t be a [0,T]-valued stopping time. Then the mappings 

A' X 4+ (J-,) 3 (A,0 ^ u^iO e ^°(-^r) 

and 

A' X Ll^Tr) 9 {X,0 ^ X^/ e Ll^ 

are both jointly continuous. 

Theorem 1.9. Let t be a [0,T]-valued stopping time. Assume that NFLVR is satisfied for a given 
A € A, the Inada conditions on U hold, that u^{^) < oo for some ^ G L^_^_{Tt-), and that the 
asymptotic elasticity of U is less than 1. Then 

(1) u^{£,) < oo for all ^ G and v^{r]) < oo for all 7] G L^_^(JV). 

(2) and are both differentiable (as maps from L^ — t- L^), and their derivatives vary 
continuously when all spaces are endowed with the L^ topology. 

(3) v^{'r]) = esssup {u^{^) — ^ry), and u^{S,) = essinf {v^{ri) + r/^), i.e. and are 

conjugate. 
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(4) The optimal solution Y^^-^ £ to the conditional dual optimization problem exists, and 
the optimal solution X^''^ £ to the conditional primal optimization problem exists. For 
-q = (u^)'(^) G Ll^iTr), we have the dual relation rjYji'^ = U'{^X^'^). 

Section [2] is devoted to the proof of this duahty result, parts of which appear in [8]. 
We use the first part of Theorem 11.81 to prove the corohary below. 

Corollary 1.10. Let A' be a V -relatively compact subset of Km, with an appropriate topology on 
K, and let t be a stopping time. Then the mapping 

A' X M++ 3 (A,x) ^ X^'^ G ^++(-^r) 

is continuous. 

2. Convex Duality 

Let Q be an arbitrary sub-sigma algebra of F, which in applications will have the form J>, for 
r a stopping time. In this section, we prove a duality relationship between abstract versions of 
and v^, employing the Minimax Theorem of Appendix A. Afterwards, we show that this abstract 
framework encompasses the particular case we are interested in. This section is based on Sections 
3 and 4 of [4| , as well as parts of [6] . 

We state here ^-measurable analogs of convexity for sets and functions. The former concept has 
been defined in, i.e. [9]. 

Definition 2.1. A set K C LP will be called Q-convex if, for x,y £ K and g G mQ such that 
< 5 < 1, (7X + (1 — g)y G K also. 

Definition 2.2. Let f : L^ ^ L^ . We say that f is Q-convex if for any Q-measurable random 
variable g such that < (7 < 1, and xi,X2 G L^ , we have f{gxi + (1 — g)x2) < gf{xi) + {1 — g)f{x2). 
We say that f is strictly Q-convex if the inequality above is strict on some nonneglible set provided 
that g takes values other than 1 and 0. 

The definition of a ty-concave and strictly ty-concave function are defined as above, with the 
inequalities reversed. 

2.1. Some properties of L^ — ?> L^ maps. We collect here some mathematical results which 
generalize classical results from convex analysis. 

Lemma 2.3. [Biduality] Suppose that u : L\j^{Q) L^{Q) is Q-concave, and that v satisfies 
v{rj) = ess sup {u{^) — ^r]), for rj G L^j^j^{Q). Then 

'u(^) = essinf {v{ri) + £,rj). 

Proof. Consider the set F* of pairs G L^^{Q) x L^{Q) such that the affine function h{^) = 

^rj + fj. majorizes u. We have h{^) > u{^) if and only if /i > ess sup (n(^) — rjS,) = v{rj). Thus, F* 
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is seen to be the epigraph of v. Since u is ^-concave, it is the pointwise essential infimum of the 
affine functions /i(^) = (.rj + fi, for (r/, /x) e F*. Thus, u(0 = essinf (vM + r]^), and both parts 

of the conjugacy relationship are established. □ 

For z £ L1_|_(C/), we say that z* G -L° is a subdifferential of the ^-convex function v at z if 
v{r]) > v{z) + z*{r] — z) for all rj G LP^^{Q), and we denote this by z* € dv{z). The superdifferential 
of u is defined analagously, with the inequality above reversed. As in the classical real-valued case, 
the bidual conjugacy between u and v and some algebraic manipulation implies that z G dv{z*) if 
and only if z* G d{—u){z). 

Definition 2.4. We say that a Q- convex function v is differentiable if its subdifferential contains 
a single element at each point in its domain. 

Lemma 2.5. Suppose that v is strictly Q-convex. Then its conjugate u is differentiable. 

Proof. According to the discussion above, the superdifferential of u is —{dv)~^, and this mapping is 
single- valued if and only if u is differentiable. Consequently, it suffices to show that dv{r]i)r)dv{r]2) = 
for r]i ^ r]2 in L^^{Q). Suppose that rj* € dv{rii) n dv{rj2). The graph of h{z) = rj*z — u{r]*) is 
a supporting hyperplane H to epi v that contains {rii,v{rji)) and {r]2,v{r]2)). Hence, v cannot be 
strictly ^-convex along the line segment joining t]i and r/2. 

□ 

2.2. The Abstract Convex Duality Problem. Suppose that C and V are subsets of L^{J^) 
which are 

(1) ^-convex, solid, and closed in the topology of convergence in probability, and 

(2) g eC if and only if E[gh \ G] < 1 for all /i G P, and /i G D if and only if E[gh \ G] < I for 
all g & C, and 

(3) The constant function 1 is in C. 

Note that the second and third conditions imply that D is contained in the unit ball of L^. For 
C G LliG), let C{C) = iC. Define V{r]) similarly for t/ G L%^{G). 
We consider the abstract utility maximization problems 

{t(0 = ess sup E[U{g) \ G], v{t]) = essinf E[V{h) \ G], 

for e G LliG) and ?? G Ll^{G). 

Throughout this section, assume that u{^) < oo almost surely, for some ^. We also suppose 
that V and u satisfy the property of being locally defined. More precisely, we say that a map v 
is locally defined if, for ??i,r/2 G L^j^{G) and A e G, v{Iai]i + 1a=??2) = 'fAvi'qi) + l^ci}(r/2). The 
property is defined analagously for u with respect to its domain. 

We state here the abstract version of Theorem 11.91 

Theorem 2.6. Assume that the Inada conditions on U hold, that n(^) < oo for some ^ G L^^{G), 
that the asymptotic elasticity of U is less than 1, and that u,v are locally defined. Then 
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(1) u{0 < oo for all ^ G Ll^iG) and v{r]) < oo for all r? G L%^{G)- 

(2) u and v are both differentiahle, and their derivatives vary continuously when all spaces are 
endowed with the topology. 

(3) v{r]) = ess sup tt(^) — ^rj, and u{^) = essinf v{r]) + 77^, i.e. u and v are conjugate 

(4) The optimal solution Y{rj) to the conditional dual optimization problem exists, and the 
optimal solution X{^) to the conditional primal optimization problem exists. Forrj = u'{(,) G 
L^_^{Q), we have the dual relation Y{r])T = U'{X{^)t). 

The rest of this subsection is devoted to the proof of Theorem l2.6[ We first develop a few auxihary 
results. 

Lemma 2.7 (Komlos's Lemma). Let (/")n>i be a sequence of non-negative random variables. 
Then there is a sequence (7" G conv{f"', f^^^, . . .) which converges almost surely to a variable g with 
values in [0,oo]. // the convex hull of (/")n>i is bounded in probability, the limit f is real-valued. 

Proof. See Lemma Al.l in [Ij. □ 

We state here a conditional version of uniform integrability. Some simple properties related to 
this concept are proven in Section 3.1. In this section, they are used only for the following lemma, 
so we defer their proofs for ease of reading. 

Definition 2.8. Let {Xa}a^A be a collection of random variables. We say that the collection is 
Tr-uniformly integrable if for any e{ijj) G L'^^(J>), there exists some 5{uj) G L^_^_(J^^-) such that 
for Ba = {\Xa\ > 6}, then |£'[1b^Xq | < e for all a. 

Lemma 2.9. For any rj G L^_^_{Q), the family (^^(^))/igX)(»?) ^■s G-uniformly integrable. If {h^)n>i 
is a sequence in T>{r]) which converges almost surely to a random variable h, then h G T>{7]) and 

liminf I g] > E[V{h) \ g]. 

Proof. See Lemma 3.4 in [2] and Section 3.1. The first claim is proved exactly as in that lemma, 
using the modified de La Vallee-Poussin criterion for (/-uniform integrability (Lemma l3.3p . that V~ 
is strictly concave, and that the conditional expectations of elements in T>{r]) are bounded in L^. 
The second claim is also proved as in [3] using Lemma l3.4t it is merely the conditional version of 
the unconditional result given in [1]. □ 

Lemma 2.10. Suppose that v{r]) < 00 for rj G L^^(g). Then the optimal solution h{r]) to the dual 
optimization problem exists and is unique. As a consequence, v is strictly g-convex on {v < 00}. 

Proof. First, we claim that the set {E[V{g) \ t/]}^^^^^^ is downwards directed. Let 51,52 € T>{r]). 
Let A = {E[V{gi) \ g] < E[V{g2) \ g]} G g. Let g = U51 + 1a-52. Since P(r/) is ^-convex, 
g G T>{ri). We calculate that 

E[V{g) I g] = E[lAV{gi) + 1^=^(52) I ^] 

= lAE[V{gi) I g] + lA^E[V{g2) | g] 

= E[V(.9i) I G]AE[V{g2) \ g]. 
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Since the above set is downwards directed, there exists a sequence {g"')n>i in T^iv) such that 
E[V{g"') I Q] 4 v{r]) a.s. By Lemma [2.71 there exists a sequence /i" G conv(g", g""^-*^, . . .) and a 
finite random variable h such that /i" — > /i a. s. From the convexity of the function V we have 
E[V{h'') I < ess sup E[V{g'^) \ G], so that hm E[V{h'') \ G] = v{r]) a.s. 

m>n "-^^^ 

By Lemma EH E[V(h) \ G] < hminf E[V{h^) \ G] = v{r]), and /i G ^(r/). The uniqueness 

n^oo 

of the optimal solution follows from the strict convexity of V. For the strict ^-convexity of v on 
its effective domain, let r]i,r]2 G L^+{G), and let g be between and 1 and ^-measurable. Then 
gh{rji) + (1 — g)h{r]2) is an element of T>[grji + (1 — g)ri2)- We have 

v{gr,i + (1 - g)r,2) < E[V{gh{r,i) + (1 - 5)/^^)) | G]- 

Using the strict convexity of V , we have V{gh{7]i) + (1 — g)h{ri2)) < —gIa + 5^(^('?i)) + (1 ~ 
g)y {h(rj2)) provided that g is not only 1 and 0, A G corresponding to some set of positive 
measure on which h(r]i) and h{rj2) are bounded from above and g is bounded away from and 1. 
The strict ^-convexity of v is now immediate. □ 

Lemma 2.11. We have v{rj) = ess sup (u(^) — ^rj) for each rj G L^^{G)- 

Proof. For n > 0, define Bn to be the the positive elements of the ball of radius n in L°^{G)- The 
sets Bn are cj(L°°, L^)-compact. By the conditional Minimax Theorem, we have, for n fixed and all 
7? G Ll^iG): 

ess sup essinf E[U{g) — gh \ G] = essinf ess sup E[U{g) — gh \ G]', 

we use this fact later. From the dual relation between the sets C{(,) and T>{rj), we deduce that 
g G C(^) if and only if 

ess sup E[gh \ G] < Cv- 

We claim that the following quantities are equal: 

(1) lim ess sup essinf E\U(q) — qh \ G] 

(2) ess sup ess sup E[U{g) — S,r] \ G] 

(3) ess sup ess sup E[U{g) — S,ri \ G] 

• "(1) < (2)": It suffices to prove that for any n, and any g G Bn, there exists some ^ G L^iG) 
such that 

essinf E[U{g) - gh \ G] < ess sup E[U{g) -^r] \ G]- 

Take ^ G L%{G) that is minimal with respect to g being in C(^); such a ^ satisfies, by the 
duality relationship, ess sup E[gh \ G] = (,rj. In fact this duality shows that such a ^ exists, 

because we can take 

C = -essinf E[gh \ G]. 
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Then essinf E[U{g) - gh \ G] = E[U{g) - ^t] \ G] < ess sup E[U{g) - ^r] \ G]. 

• "(2) < (3)": It suffices to show that for any ^ G L'\_{Q) and any g G C(^), there exists a 

C e ^++(^) and a 5 G C(C) such that E[U{g) - \ G] < E[U{g) -l,r] \ Q]. Note that g = Q 

on = 0}, by definition of C(^). Let A = = 0} G ^. For each natural number k, write 

Bk = {k-l <ri <k} eG- Obviously the B^s partition so write A = \J{Af]Bk) = U^fe- 

k k 

Recalling that U satisfies the Inada condition, for each k, choose | such that U'{ek) > k. 
Define 

oo 

'^ = ^ + ^^k'i-Ak, 

k=l 

SO that ^ > 0. Let g = gi^^ + Claim that 'g G C(^). First, < £, implies, by the duality 
relationship, that C{^) C C(^), so that g G C(^). Noting that A & G, use the ^-convexity of 
C(0 and f G C(f) to conclude that g eC{l). 
Now, we calculate, by the convexity of U, that 

oo 

U{g) - > U{g) - + J2{U'{ek)ek - ekV^A,- 

k=l 

Note that every term in the summand on the right hand side is ^-measurable, and that 
each summand is also positive by construction. Hence, we take conditional expectations 
and deduce that E[U{g) - ^'n\G]> E[U{g) - ^r] \ G]. 

• "(3) < (1)": First, as usual, note that for fixed ^, {E\U{g) — ^r] \ G]}geC{^) is upwards di- 
rected by the ^-convexity of C(^). We claim that also < ess sup E[U{g) — ^ij \ 0]( is 

"almost" upwards directed, in a sense to be described below. Fix and ^"^ in L^_^{G)- Take 
gi G C{e) and gl G C{e) such that f (5;) ^ E[U{g:,)-erj \ G] t esssup E[U{g)-ev I G] = 

F{^i) for each i. Let ^ = i esssup E[U{g) - ^^t] \ G] > esssup E[U{g) ~ ^'^rj \ G]\ G G- 

[ 9ec(e) gecie) J 

Let ^ = 1^.^^ + Ia^C"^- Let gn = '^A9n + follows by the duality relationship that 

gn £ C(^) for each n. Furthermore, 

f{gn) ^ E[U{gn) -ir^\G] = UE[U{gl) - ^r} \ G] + UcE[U{gl) - frj \ G], 

and this quantity converges upwards towards F^{^^) V F^^'^). From this it follows that 
E{^) > F{^^) V -F(C^). This isn't quite upwards directedness, but it is sufficient for the 
essential supremum to be realized by an increasing sequence. 

Now, let g G C(^) for some arbitrary but fixed ^. Let gn = g^{g<n} ^ C(^) fl 5„ by the 
solidness of C(^). Then by the duality relationship, 

essinf E[U{gn) - gnh \ G] > E[U{gn) - h I G]. 
hev{Ti) 

By conditional Monotone Convergence, we have E[U{gn) — ^^7 | ^] t E[U{g) — ^rj \ G\- 
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Now we put the two above parts together. Let yj G C(^j) be such that E[U iyj) — £,jV \ Q] t 
ess sup ess sup E\U{g) — ^rj \ Q]. Define y"^ = yjljy <n| € n C{(,j), so that y"" t Vj for 

all j. This gives E[U{y'j) — (,7] \ Q] '[ E[U{yj) — ^rj \ Q]. Using an appropriate diagonal, we 
have the existence of a sequence {nk)k>i such that 

lim y^'' = ess sup ess sup E[U{g) — 1 G], 

and the original claim is proven. 
So, we have 

lim ess sup essinf E[U{g) — gh \ Q] = ess sup ess sup E[U{g) — £,7] \ Q] 



ess sup ('u(^) — ^r/). 



On the other hand, 



essinf ess sup E[U{g) - gh \ G] = essinf | G] = 

where V^ly) = sup [U{x) — xy]. Consequently, in light of the minimax result of Appendix A, it 

0<x<n 

is enough to show that 

lim {)"(r/) = lim essinf | Q] = v{rf). 

Clearly, < v because < V. As before, the ^-convexity of P(r/) implies that for all n, 
\ Q] : h £ T^irj)} is downward directed. Thus, by diagonalization, let (/i")n>i be a 
sequence in V^i]) such that lim | G] = lim„_j.oo By Lemma 12.71 there exists a 

n— >oo 

sequence /" € conv(/i", h'^'^^, . . .) which converges almost surely to a variable h. We have h € 'D^t]) 
because 'D{r]) is closed under convergence in probability. Since V^{y) = V{y) for y > /(I) > /(n), 
where /(•) is the negative inverse of V'{-), we know from Lemma [2.9l that (I^"(/'^)~)n>i is uniformly 
integrable. Thus, as is proven before, the convexity of and conditional Fatou's lemma imply 
that 

lim I g] > liminf i g] > E[v(h) \ g\ > dM. 

n— >-oo n— >-oo 

This shows that liuin^oo (v) — "^(v)- ^ 

Lemma 2.12. Let rjk be elements of L^_^_{g) converging in probability to r] £ L^^{g)- Let h{r]k) = 
argmin and let h{rj) = aigm\nv{ri), i.e. the optimal dual variables. Then h{rjk) — > h{r]) in 
probability. 

Proof. See the first part of [4j, Lemma 3.8. The proof here is essentially identical, and basically a 
consequence of the strict convexity of V . □ 

Lemma 2.13. Assume the same hypotheses we have in Lemma \2.1SX Then E\y' {h{r]iS))h{r]k) \ g] 
converges to E[V' {h{rj))h(rj) \ g] in probability. 

Proof. The proof is again identical to that of Lemma 3.9 in [4j. □ 
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Remark 2.14. Suppose that fij. is a sequence of Q -measurable random variables converging uni- 
formly to 1. Then we can still conclude that E 



V (^fikh{r]kfjh{7]k) I G converges to E V {li{if)^h{ri) \ Q 



in probability. The reasoning is identical to that of [A\ in Remark 3.1. 

We say that v is Gateaux differentiable at ry G L^j^j^{Q) in the direction b G L^j^_^{Q) if 

^'(r?;6)^lim^fc^^l^ 

s->0 S 

exists as a hmit in probabihty. We denote by v^{rj] b) the one-sided right-hand Gateaux derivative, 
calculated only as s J, 0. 

We first assume that 77 is bounded away from zero, and that b G L°°{Q). This ensures that for s 
sufficiently small, ry -|- s6 G L^^{Q), the domain of v. 

Lemma 2.15. The limit v'{r]; b) exists in probability for r/ andb as above, and is equal to ^E\Ji{rj)I{h{rj)) \ Q], 
where I = -V = {U')'^ . 



Proof. The proof is very similar to Lemma 3.10 of [4j, but differs slightly on the technical details. 
First, we claim that —r]v'{r];b) = lini^^^^^^^^Y^-^, provided that this limit exists in probability. We 
have 

virf) — vis^T]) ufexpflog 77)) — ufexpflog s'' -|- log 77)) 
lim = lim 

s^l S — \ s^l S — 1 

Ve{logr]) - Ve{b\ogs + \ogr]) 
= iim , 

s-s>l S — 1 

where Vf.{ri) = 7)(exp(?7)). As s — )• 1, logs = s -|- o{s). Hence, this last quantity would be equal to 
— 'Ug(log ??; 6). We then calculate that — ■Ug(logr/; 6) = — ■u'(exp(logr7); 6) exp(log 77) = —t)' (77; 6)7/. 

Note that all of the above was contingent on the limit being well-defined in probability. We now 
show that 

P-limsup^^^^^^^^^^^^ < -bE[h{r])I{h{T])) \ G], 



and that 



P_liminf ^^^^^ > -bE[h{r])I{h{r])) \ G]. 

sll S — 1 

By Lemma 12. 12^ the map 77 1— >• E[h{rj)I(h{rj)) \ G] is continuous in probability. Thus, if we can 
prove the above two inequalities, we will have shown that v^{r]; b) is continuous in 7/. Given that v 
is ^-convex, we know, as in the real-valued case, that this is sufficient to prove the differentiability 
of V in the direction b. If there is a point of non-differentiability, there must be a discontinuity of 
the right-handed derivative. 
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For the first inequality, we have 



P - lim sup — < P - lim sup -^E[V{\h{s^r])) - V(h{s%)) \ Q] 

1 1 . 1 



< P - lim sup ^E[{^ - I G] 



P - limsup - l)E[h(s''r])V'(^h(s''r])) I Q] 

-bE[h{v)l(h{v)) I 



by Remark [2TTil using the fact that b e L°°{g). 
For the second inequality, we have 

P - hminf '(^^ - '^^'^^ = P - liminf -± 

sll S — 1 sll S — 



jE[V{h{7^)) - V{s'h{rj)) I g] 



> liminf ^^^[(1 - s'')h{ri)V'{s''h{'n)) \g] 

sll S — 1 

= -bE[h{r^)I{h{7i)) I g], 
where the last equality follows from the conditional monotone convergence theorem. 



□ 



We cannot at first define the Gateaux derivative of v for all points in its domain, due to the fact 
that L^_^_{g) is not open in L^{g) whenever the underlying set Q is not finite. Using the locally 
defined nature of v, we can still actually define v{r];b) for arbitrary rj € L^^{g) and b G L^{g) as 
a kind of "a-derivative" . We extend the definition of Gateaux derivative to all r] £ L^^{g) and 
b € L^{g) as follows. 

First, let r] G and b G L'^_^{g). For natural numbers n, let An = {rj > ^}. Let 

rjn = rj^An + Note that ry„ is bounded from below, so that for b G L°°{g), the directional 

derivative v'{r]n;b) is well-defined. For m > n, note that r]^ and agree on An, so by the local 
property of v, we see that v'{r]m] b) and v'{r]n; b) agree on An- Thus, we can safely define 



v'{v;b) = ^i'{T]n;b)lA„ 



\A„ 



n=l 



We now do a similar thing to extend the allowable b values. For b G L^{g), let P„ = < n} 
for n > 1. Let 6„ = 61_b„ +nl(B„)c. Since each bn is bounded, v'{ri;bn) is well-defined. Again using 
the local property of v, we consistently define, for t] G L^^{g), v'{r]; b) = v'{r]; bn) on P„. 

According to Lemma 12.151 for r] G L^_^_{g) and bounded away from zero, we have v'{r]) = 
^E[h{r])I{h{r])) \ g], noting the relationship between the subderivative and Gateaux derivative. 
The mapping r] i— > E[h{rj)I{h(r])) \ g] is defined locally, because r] i— t- h{r]) is. This implies that 
Lemma [2.151 can be extended to all r] G L^_^_{g)■ We have: 

Lemma 2.16. Let r] G L\+{g)- Then v'{rj) = ^E[h{r])I{h{r])) \ g]. 
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Lemma 2.17. Suppose that the random variables ^ and rj are related by = —v'{rj). If h(rj) is the 
optimal dual variable, then g{C) — I{h{ri)) is the optimal primal variable. 

Proof. See Lemma 3.11 of [4j. 

□ 



We are now ready to prove the main result of Section | 
Proof of Theorem 12.61 By hypothesis, 'u(^) < oo for some ^. The concavity of U implies that u 
is t?-concave, and it follows that u(^) < oo for all 4. Lemma [2.151 establishes that v{ri) < 00 for all 
r]. This finishes Part 1. 

The continuous differentiability of v follows from Lemmas 12.161 and I2.13[ The differentiability of 
u follows from the strict ^-convexity of v, established in Lemma [2. 10 1, and Lemma [2. 51 By plugging 
in g{^) = I{h{r])) and rj = 'u(^) into the formula for v' , we obtain C^'iC) = E[g{S,)U' {g{^)) \ Q], 
which is shown without too much difficulty to be continuous. This is Part 2. 

Part 3 follows from Lemmas 12.111 and 12. 3^ and Part 4 is the content of Lemma 12.171 □ 

2.3. Convex Duality in the Financial Setting. We prove Theorem 1 1 . 91 her e . First, we establish 
the local property of v^, since in Section we assumed this property to hold. 

Lemma 2.18. Let A £ J>, and let r/i,r/2 € L']_^(J>). Then v^{lA'ni + 1a=??2) = lA'yT(^i) + 

Proof. Write rj = IaVi + 1a=^2- By the J>-convexity of v^, we know that v^{ri) < lAV^{rii) + 
l^ct)^(r/2). Now, we calculate 

= essinf E[lAViZ^mYT) + lA^V{Z^mYT) \ J'r] 



ess inf 



lAE[ViZ^mYT) I -F.] + lA^E[V{Z^mYT) I -F.] 



> essinf lAE\V(Z^riiYT) I JV] +essinf lAcElViZ^mYr) I 



U<(r/i) + Uc<(??2). 



□ 



We now may prove the theorem. 
Proof of Theorem 11.91 We apply the abstract results of the previous setting. For r a stopping 
time, we let C(^) be the solid hull of -^^(Oi with ^ S I/+4.(J>), and we let I'(r/) be the solid hull 
ofy^{r]) for 7] G L%{Tr). Note that by passing to solid hulls above does not change either the 
primal nor the dual value function, because U is increasing and V is decreasing. 

We must prove that C(^) and I'(t/) satisfies the properties of the previous subsection. Zitkovic 
proves this exact result in Theorem 4 of |9j. Thus, the application of Theorem 12.61 completes the 
proof. □ 
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3. Dual Continuity 

In this section, we prove that for any stopping time r, the mapping (77, A) v^{r]) is continuous 
from -C/^|__)_(J>) X A' to L°(Jv)- All spaces of random variables above are topologized by convergence 
in probability, and the source space has the product topology. The next two subsections contain 
some technical results needed to work with random variables which have finite Jv-conditional 
expectation but are not necessarily intcgrable. We state the lemmas, but leave the proofs to the 
reader, as they are similar to their classical counterparts. 

3.1. Mathematical Preliminaries for Proving Continuity. 

Lemma 3.1. (Conditional Dominated Convergence) Suppose that are positive random variables 
converging in probability to the positive random variable Y. Suppose that we have Y^ < = rjkUk 
for each k, X). X = rjU in probability, and E[Xf^ \ Tr] E[X \ Jv] in probability, where 
r]k,r] G L\^{Fr) and Uk,U G L\^. (In particular, all the quantities given are well-defined and 
finite). Then E[Yk \ Fr] E\Y \ Ft] in probability. 

Proof. Recall that convergence in probability is equivalent to the fact that from any subsequence, 
one can extract a subsubsequence converging almost surely. Take an arbitrary subsequence {E[Yk^ \ ^T]}n>i- 
We must find a subsubsequence that converges almost surely to E[Y \ Ft]. Extract a subsubse- 
quence (A;„.) such that Yk„, Y almost surely and Xk^, — >■ X almost surely. Hence, it suffices 
to prove this result in the case that every instance of convergence in probability is replaced with 
almost sure convergence. 

Note that both X^+Yk and Xk—Y^ are nonnegativc random variables for all k. By the generalized 
conditional Fatou's Lemma, and the hypothesis, wc have 

E[X + Y\ Ft] < ]immiE[Xk + Yk \ Ft] = E[X \ Ft] + limmi E[Yk \ Ft], 

E[X -Y \Ft]< l[mmiE[Xk - Yk \ Ft] = E[X \ Ft] - limini E[Yk \ Ft]. 

fe— >-oo fe— >oo 

Subtracting E[X \ Ft] < 00 from both sides, we obtain 

E[Y I Ft] < limini E[Yk \ Ft] and E[Y \ Ft] > limsup E[Yk \ Ft], 

and this implies the result. □ 

Given a sequence of random variables {Xn)n>i, we define the limit superior in probability 
of the Xn, denoted P — limsup, by 

P - limsup X„ = essinf {X : for all e > 0, P{X < X„ - e) ^ 0} . 

We define the limit inferior in probability of the X„, denoted P — liminf, by 

P - liminf X„ = esssup {X : for all e > 0, P(X < X„ + e) ^ 0} . 

n->-oo 

Note that X > P — lim sup Xn and X < P — lim inf Xn is equivalent to Xn — >■ X in probability. 
Furthermore, since almost sure convergence is stronger than convergence in probability, it is always 
true that P — limsup Xn < limsup Xn and P — liminf Xn > liminf Xn. It is clear that each of these 
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inequalities may be strict. Before proceding, we clarify the question of existence of P — lim sup's 
and P — lim inf 's. By definition, such random variables must be unique. We prove existence here 
for P — lim sup's, the argument for P — lim inf 's being identical. 

Lemma 3.2. Let Xn be a sequence of random variables. Then P — lim sup X„ exists in the sense 
of an extended random variable. 

Proof. Consider the set of extended random variables A = {A : P{A—Xn < —e) for all e > 0}. 
Obviously oo € so that A 9. We claim that the set A is downwards directed. Indeed, for 
Ai,A2 € .A and e > 0, P{Ai N A2 - < -e) < P{Ai - X„ < -e) + P(^2 - < -e) ^ 0. 
Downward directedness implies that there exists a sequence Ai,A2,... G A with the property that 
An 4, j4 = ess inf A. We claim that A is the P — lim sup of the X„. It suffices to show that A G A. 
Otherwise, there exists e > such that for infinitely many n, P{A — Xn < — e) > e. By Egorov's 
Theorem, there exists a suitably large j such that |j4 — Aj| < | except possibly on a set of measure 
less than |. These two observations imply that for infinitely many n, P{Aj — Xn < — |) > |, but 
this contradicts the fact that Aj € A. Hence, A £ A. □ 

Lemma 3.3. (Conditional de la Vallee-Poussin) Let {Xa}aeA be some family of random variables. 
Let G{x) be a nonnegative increasing function such that hm = 00. Then if {E[G{Xa) \ Tr]}a€A 
is bounded in probability, then {^ala gA is -uniformly integrable. 

Proof. Suppose for contradiction that the family {Xa}aeA is not J>-uniformly integrable. Then 
there exists an e G L^_,_(Jv) such that for any 5 G Ll^(J>), there exist X^ and B = B{6,a) G Jv 
such that EllsXa \ -7>] > e, where B{5,a) = {Xa > 5}. Let {Xn,6n) be pairs as above, for 5n 
tending uniformly to 00 (we'll just set J„ = n). Suppose then that > kn for x > n, where 
knt 00. Then, we have 

E[G{Xn) I Tr] > E[lB^s^^n)GiXn) \ Tr] > A:„E[1b(5„,„)X„ [ Tr] > knt. 

This clearly contradicts the bounded in probability hypothesis. □ 

Lemma 3.4. (Conditional Fatou's Lemma) Let (X„)„>i be a sequence of random variables such 
that Xn X in probability. Suppose that the negative parts (X~)„>i are Tr-uniformly integrable. 
Then a version of Fatou's Lemma holds: 



E 



lim inf X„ | J> 



< P-liminf£^[X„ | Tr] 



Proof. The proof is standard. Considering the negative parts, by using an increasing sequence of 
truncations, we apply Lemma 13.11 to obtain convergence in probability of the conditional expecta- 
tions of the negative parts. We then just apply the standard conditional Fatou's Lemma to the 
positive part in order to obtain the result. □ 

Suppose that in some metric space 0, we have Xi — ?> x. Given a mapping (p from into L^, we 
will say that (p is upper semi-continuous if > P — lim sup ^(xj). We say that (p is lower 
semi-continuous if </>(x) < P — lim inf 4>{xi). 
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Lemma 3.5. For some arbitrary index set 3, let fi : — > , for each i, be an upper semi- continuous 
mapping from an arbitrary metric space into LP . Then the mapping f from Q to LP defined by 



f{x) = essinf fi{x) 

iG3 



is also upper semi- continuous. 



Proof. By a familiar subsequence type argument, it suffices to prove the lemma replacing the 
probabilistic convergence with almost sure convergence. Let xj ^ x in X . We must show that 
/(x) > limsup/(a;j). For each i £ I, we have by hypothesis that fi{x) > limsup/j(xj). Taking 

essential infimums over i yields /(x) > essinf limsup/j(xj) > limsup essinf fi{xj) = limsup/(xj), 

Xj^x Xj^x Xj^x 

where the last inequality follows from the same reasoning as in the easy direction of the minimax 
theorem. □ 

3.2. Proving Continuity. 

Lemma 3.6. Let A G A' and suppose that v^{r]) < oo for rj G L'}__|_(J>). Then there exists 
a local martingale L'^'^ , strictly orthogonal to M when restricted to [t,T], such that v^{rj) = 
E[V{r,Z^8{L^^>^)) I Tr]. 

Proof. By Lemma I2.1UI there exists Y S such that v^{r]) = E\V{riYT) \ J>]. By Proposition 
3.2 of [5J, y = Z^£{L)D with L strongly orthogonal to M on [t, T], and D is a decreasing process. 
Because V is strictly decreasing, and because Z^£{L) G 3^"^ by virtue of (L,M) = 0, it must be 
that D = l. □ 

Corollary 3.7. Let B denote the set of all local martingales L, strongly orthogonal to M when 
both are restricted to the time interval [t,T], such that the terminal value £{L)t is bounded from 
below by a positive constant. Let A G A' and suppose that E[V+{Z^) \ Fr] < oo. Then for each 
Tj G L1_,_(Jv), we have the representation 

v^iTj) = essinf E[VivZ^£iL)T) \ Tr]- 

Proof. The proof is similar to that of Corollary 3.4 from [5]. First, we write down a solution to the 
unrestricted optimization problem. The optimal terminal value may not be bounded away from 
zero, so it is then truncated from below, and it can be shown that these approximations yield 
converging approximates to the value function. 

□ 

We now apply Lemma l3.1l to obtain the equivalent of Lemma 3.5 in [5j. 

Lemma 3.8. Let be a random variable, bounded from below by a strictly positive constant, such 

that supii^[Z-^^] < oo. Then the mapping A) i-^ E[V{r]Z^^) \ J>] is upper semi- continuous from 
AeA' 

LlJTr) X A' into L^{Tr). 
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Proof. Define the map analogously to (j), except that V is replaced with V~^. To prove the upper 
semi-continuity of cp, it suffices to prove the continuity of (/>"*", because we get upper semi-continuity of 
the negative part for free by conditional reverse Fatou's Lemma. In any case, we will now just assume 
that F is a nonnegative function, and that V{y) = for sufficiently large y. Let {rjk, Z^) — )■ (ry, Z^). 
We put ourselves in the context of Lemma |3.1[ Let Yfc = V(t]\^^^^. By the asymptotic elasticity 
assumption on {/, we have by Lemma 6.3 of 0] that < Cr]~"'V{Y^''0 + D = X^, where C, D > 
are constants, as is a > 0. For completeness, actually a = y^:^, for 7 the asymptotic elasticity of 
U. Clearly, by the continuity of F, we have ^ y = V{r]Z^C) and Xk ^ X = r]-'^V{Z^C), both 
in probability. Since all % and r] are Jv-measurable, then 

E[Xk I Tr] = Vk^EiViZ^'O 1 -^r] ^ Tl-'^ElViZ^O 1 JV] = E[X \ JV], 

where the convergence above is a consequence of the uniform integrability established in Lemma 
3.5 of [5j. The proof is now complete by Lemma |3. II □ 

Lemma 3.9. The function (t/. A) 1-^ v^if])' mapping L*|__,_(J-V) x A' into L^{Tr) is upper-semi 
continuous. 

Proof. By Corollary [321 the dual value function v^{-) has the representation v^irj) = ess^nf E[V{r]YTZj,) | J>], 
where the infimum is taken over Y = £{L) for L ^ B. For such a random variable, by Lemma 13.81 
the mapping (??, A) i-)- E[V{r]Y Z^) | J>] is upper semi-continuous. Therefore, by Lemma the 
mapping (ry. A) 1-^ is upper semi-continuous, as an essential infimum of upper semi-continuous 

mappings. □ 

We will prove lower semi-continuity by approximating the value function from below. We have 
this preparatory lemma. 

Lemma 3.10. Let A^ — t- A appropriately, and let rji^ ^ r] in L']__|_(Jv), and suppose that are 
all uniformly bounded from below. Then v^''{rik) — > v^{ri), i.e. (?/, A) 1-^ v^iv) "^^ continuous when 
restricted to r] bounded away from zero. 

Proof. Let (Xk^ilk) (A,??). Lemma [XHl implies that the mapping is upper semi-continuous. Sup- 
pose that is not lower semi-continuous. By passing to a subsequence, we assume that there exists 
/3 > such that for all k, P{v^{rj) > v^H^) + /?) > /5, and that r]k ^ r] and Z^* Z^ almost 
surely. Since r]k ^ r] a.s., Egorov's Theorem (p. 73, [7J) implies that for any e > 0, there exists 
a set A ^ Tr with P{A) < e, such that r/^l^c, r/ly^c are all uniformly bounded from above, for k 
sufficiently large, with an upper bound of M € M+; to see this, we first find a small set outside of 
which r] is bounded, and we then use Egorov's theorem to find another small set outside of which 
the convergence is uniform. We will take e to be small compared to /3. 

Set X>^{r]) = E[v^{rj)lAA- By construction, ^^{rj) is finite: for the negative parts, by Lemma 
I2.10|, we have v^''{rij.) = E[V{rif^Y,^) \ Jv], where the optimizer Y^ = Y^'"^*' can be written as 
Z^''8{L^)t, for some local martingale = L*"-'^* that is strongly orthogonal to M on [r, T]. Then 
note that v^''{'qk)lA- = E[V{r]kY^) \ J;]1a- > E[V{MY^) \ J='r]lA- since A e Tr, and this term's 
negative part is integrable, since MY,^ G and V~ is strictly concave. In fact, the negative parts 
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parts of f^'-' (r/fc)l^c are also uniformly integrable, since the collection {MY^}k>i is bounded in L^. 
The positive parts are controlled by the fact that rj is bounded away from zero together with the 
asymptotic elasticity hypothesis and ^-compactness assumption (in fact this logic implies that the 
positive parts of {t'r'°(%)}fc>i are uniformly integrable). 

By Lemma 13.91 we already know that (A, ry) i— t- v^(ry) is upper semi-continuous. This means 



that {v^{r]) —v^'={r]k)) — >■ in probability. Thus, [lA'^iv^iv) 



in L , since these 



random variables are uniformly integrable. Writing t)^{r])—t)^'= (rj^) = E {\j\c{v^{ri) — v^'= (%))) 
E (lyic(ti:^(ry) — t;^'=(r/fe))) , it therefore must be the case that 0^(r/) > t)^'=(%) + /3{(3 - e) for k 
large, because (lyic(t)^(r/) — v^'' {rj^))")^ > /? on a set of measure at least /? — e. 

Note that the collection {Z^'^ £{L^)T}k>i is bounded in L^. Hence, by Komlos's Lemma, there 
exists a random variable h G Ll(J>) and such that 

j(k) 

hk = a^jr]jZrp^ £{V)t — )• h a.s., 



j=k 



with the > such that Ylj=k ^' ^^^^ have used the fact that ijf^ 

which is preserved under convex combinations. This then implies that 



r] a.s., 



fk = q!]£{L^)t — > r, almost surely. 



ttO a -ttAsO 



The random variables fn are all in = (since each L is orthogonal to M), which is closed 

with respect to convergence in probability by Lemma 4.1 of Therefore, the limit 

implying that ^ G 3^^. 



Note that < E 



TjkE 



Zrp'' £{L^)t I Ft < fyfc, where the last inequality 



is due to the supermartinagle property of deflators. Since rjk ^ f] a.s., it follows that the collection 



E 



r]kZ^''£{L'')T \ J^T ) is bounded in probability, as well as the collection {E[hk \ 



k>l 



By Lemma 13.31 the collection {V {hk)}k>i is J>-uniformly integrable. Applying Lemma 
the first inequality below, we have 



k>i- 
for 



v^{r]) < E[V{h) \Tr] = E 



V ( lim inf hi 



< P 



lim inf E 

k—^oo 



viY^c^'rjjZ^'SiL^W 
\j=k 



j(fe) 

< P - liminf Va*^£; 



v[vjz;'£{V)t) |j; 



J{k) 

P — lim inf >^ a. 



These calculations imply that 



j(fc) 



t;^(r/)Uc < P 



lim inf o^aVt^ (rij , 



J{k) 



l^c = P - lim inf a'^Vr^ (r]j)lA 
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By the standard Borel-Cantelli method, we can pass to another subsequence so that the P— hminf 
above is less than the classical lim inf of this subsequence. Taking expectations and applying Fatou's 
Lemma, we have V^{r]) < liminf Yli=k (^^^r^ iVj) ^ ^riv) ~ l^iP ~ f)) ^ contradiction. 

□ 

Proposition 3.11. The mapping {ri,X) i— )• as defined above is continuous. 

Proof. Thanks to Lemma 13.91 it is enough to show that the map is lower semi-continuous. 
For n G N, 7/ G L+_|.(J>), and A G A', we set 

Since V is decreasing, we have Vr''^{r]) < Vr'^^''^{ri) for every n. For fixed A, Theorem 11.91 
guarantees the continuity of v^{-). Thus, we know that VT'^{ri) f ^^(77) as n ^ 00. Thanks to 
Lemma l3.10( the mappings A) ^ v"'''^{ri) are lower semi-continuous. Since v^'^{ri) f v^{ri), it 
now follows by Lemma [331 that (??, A) 1-^ v''^{ri) is lower semi-continuous, and hence continuous. □ 

4. A-CONTINUITY OF (v^)' 

From the economic motivation of the problem, our initial hypotheses involve appropriate conver- 
gence of the markets, as well as convergence of initial wealth. We want to prove some convergence 
on the dual side, and then bring things back to the primal. However, we need a way to obtain 
convergence of dual "initial wealths" from convergence of (primal) initial wealths. Given the rela- 
tionship ^ = —{v^y{r]), this implies that we need stability of derivatives with respect to A. This 
section is occupied with establishing such continuity, which is a classical result in traditional convex 
analysis, but here requires some additional effort. The basic strategy is to prove uniform conver- 
gence of v^{r]) when 77 ranges over sets with a suitable analog of compactness. Naturally, uniform 
convergence then leads to the convergence of derivatives. 

4.1. Convex Compactness. Given K C L^, we define the Jv-convex hull of K, denoted convj-^ (-^)) 
to be the set of all finite J>- convex combinations of elements in K. 

Definition 4.1. Let K C We say that K is Tr-convexly compact if 

(1) K is J-r-convex and closed with respect to convergence in probability. 

(2) For any sequence (kn) in K, there exist hn G convjr^{kn, . . .) such that hn ^ h G K a.s. 

In the rest of this section, K will denote an arbitrary Jv-convexly compact set. 

Lemma 4.2. Let K C Then for any a > 0, the random variable X* = X*{a) = 

ess sup is finite. 

Proof. By standard arguments, the collection : X G A'} is upwards directed. Hence, take 

Xn G K such that t ^* ■ Suppose that there exists a set C with P{C) > on which X* is 
infinitely large. Then X„ — t- but this last random variable is not contained in -^^^-i.. Since 

K is closed, it cannot be that it is contained in a contradiction. □ 
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Lemma 4.3. Let K C L'^_|_(Jv), and let A„ ^ A appropriately. Let v*{rj) = ess sup Then 

n 

ess sup v*{ri) < oo. 

Proof. Recall by definition that v'^{'q) < E[V{r]Z^'^) \ J>]. By the assumption on the asymptotic 
elasticity of U, we have V{7]Z^") < Cr]-WiZ^") + D, where 7 > is a constant derived from 
the asymptotic elasticity of U and C, D are constants independent of the choice of r] or n. This 
estimate implies that v*{r]) < Cry"''' ess sup E[V{Z^") \ J>] + D. By the F-compactness hypothesis, 

n 

esssup E[V{Z^") I Tr] = Zk < 00. We conclude that esssup v*{7]) < CZxesssup r]^^ + D. By 
Lemma 14.21 this last quantity is finite almost surely. □ 

Lemma 4.4. Let K C L\^{Fr). Then k* = ess sup k is finite. 

Proof. By J>-convexity, the set {k : k £ K} is upwards directed. Hence, we can take a sequence 
kn t Suppose that k* were not finite. By passing to J>-forward convex combinations of the 
of the kn, we can assume that they converge almost surely to some random variable k £ K. But 
almost sure convergence is preserved under convex combinations, and so A; = A;*, and this is a 
contradiction, since elements of K are real-valued random variables. □ 

Lemma 4.5. Let K C L9 , (J>), and let (vr)*(r]) = essinf v'^ivj). Then (fr)** — essinf {vt)*{'1]) > 

n rj^K 

— 00. 

Proof. Note that for fixed rj, {vr)*{r]) > —00, because (ti"(?7))„>i is cauchy for all 77. Fix some 
7?o G and let /3i = {vr)*{'r]o)- Let e = e{uj) G Ll_,_(J>) be such that for any / G L^(Tr) with 
I/I < e, we have tjq + f G L^_^_{Tr)■ The collection X = {rjQ + / : |/| < e} is an Jv-convexly 
compact set, using Komlos's Lemma. Hence, by Lemma [4.31 let /32 be an upper bound for (vr)* on 
this set. 

Let r] be an arbitrary element of K, distinct from tjq. We are trying to show that (fr)* is 
uniformly bounded from below on the set K. Since each Vr has the local property, so too does 
(vr)*. In particular, this means that on the set {r/o = rj}, (vt)*(?7o) agrees with (wt )*(??)• Thus, we 
may assume without loss of generality that 7]q ^ i]. 

Let 

z = rjo + -, r(??o-??), and A = — — r. 

\Vo-v\ 

A simple calculation shows that rjQ = (1 — X)z + Xrj. Furthermore, the Jv-measurable random 
variable A lives between and 1, and z £ X . Thus, we have, for any n, 

/3i < <(%) < (1 - A)<(z) + A<(7?) < (1 - A)/32 + A<(r?) < /32 + A<(7?). 

Consequently, we obtain v^ij]) > ^^^^^ = ('^+l'?o~'?p(^i~fe) _ Taking infimums over all n, we obtain 

{Vt)*{V) > > 



e e 
noting that the quantity /3i — /32 is negative. Hence, by Lemma [4.41 it follows that (ur)* is uniformly 
bounded from below on K. □ 
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Remark 4.6. Compare Lemma [^.5| to Theorem 10.6 in [6j. The "neighborhood" we use does not 
contain any open sets. Furthermore, the domain for Vr, which is is not an open set in 

Lemma 4.7. Foralln, and for all x,y G K, we have \v^{x)—v^{y)\ < a\x — y\, where a € L++(Jv) 
does not depend on n. 

Proof. In Lemma 14.21 the proven result is equivalent to the fact that essinf A; > 0. Thus, there 

k£K 

exists a random variable e € Ll_^(J>) such that the set X = {k + f : k G K, |/| < e} is contained 
in L'^^(J>). It is also clear that X is Jv-convexly compact. According to the Lemmas 14.31 and 14.51 
let ai,a2 € L^{Tr) be, respectively, upper and lower bounds for all of the t>" on X. 

Let X and y be two distinct points in K, and let z = y + \ yLx \ ~ ■^)" Then z X, and 

y = {1 — X)x + Xz, 

for A = -Tr~~i- Let n be arbitrary but fixed. By the J>-convexity of v", we obtain 

<(?/) < (1 - A)<(x) + A<(z) = + A«(z) - <(x)), 

and consequently, — v!^{x) < X{a2 — ai) < a\y — x|, for a = . By switching the places 

of x and y, we can obtain |f"(y) — v!^{x)\ < X{a2 — ai) < a\y — x\. □ 

Corollary 4.8. The are equi-uniformly- continuous on K as above. 

4.2. Another Kind of Compactness. Note that if C L'|_,_(J>) is J>-convexly compact, then 
K is closed under pointwise minimization (and maximization). Indeed, let ki,k2 € K. Let A = 
{ki < k2} e J>. Then kiAk2 = l^^i + 1a=^2 G K. 
In this section, we want to prove the following result: 

Proposition 4.9. Let {ki, k2, ■ ■ ■} be a sequence in K . There exist yf^K such that y^ < ki and 
J^r -measurable partitions vr" = {A^, . . . , such that for 

J{n) 
j=n 

there exists a random variable f € K such that fn^f almost surely. 

To set notation, we call such an /„ above an Jv-partition subcombination of {ki, . . .} in i^. 
Proof of Proposition 14.91 

The proof is inspired by the proof of Komlos's Lemma in Section 9.8 of [3]. For a positive integer 
n, define 

r N 

= < ^AjDj '■ € N, {An., . . . , An} is an J> — partition of fi, yj G K, yj < kj 

\^j=n 

Since K is J>-convex, it follows that C K for each n. We know that ess sup v^{k) < oo, 

k£K 

by Lemma [4.31 It thus follows that gn = ess sup v^{k) < oo. Furthermore, the sequence (gn) is 
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decreasing since D K^^^ for all n. Since essinf v^{k) > — oo by Lemma [4.5l (this result is rather 
stronger than what we need), it follows that lim Qn — 9 ^ L^i^r)- 

Note that each inherits Jv-convexity from K. This and the locality of imply that the sets 
{v^{k) : k G K^} are upwards directed. Hence, for each n, we take a sequence (gi,) in v^{K^) 
such that gn t dn almost surely. Extract a "diagonal" glT € KJ^ so that glT — > in probability. 
Here, is just some increasing subsequence of the natural numbers. 

Given that g^rT £ v^i^^), take x„ G such that v^{xn) = glr ■ We claim that the sequence 
is Cauchy in probability. Recall the function V : M4. M. from which is defined. Note 
that V is strictly decreasing. This means that for a > 0, there is a /3 > such that for x,y M+, 
if X — y > a and x A y < a^^, we have V{y) — V{x) > (3. For fixed n > m and a > 0, let 
A'^ = A'^{n, m, a) = {xn — x„i > a,Xn f\ Xm < a^^}, and let = A~{n, m, a) = {xn — Xm < 
-a,Xn AXm < a^^}. 

Thus, we have v^{xnAxm) > v^{xn) + P^a- and f^(x„AXm) > v^{xm) + f^^A- ^ using the locality 
of v^. Combining these two inequalities, we obtain v^{xn AXm) > ^{v^{xn) + v^{xm)) + (31a, where 
A is defined as A~^ U A~ . This implies that 

/31a < V^{Xn A Xm) - ^{Vr{Xn) + v{Xm))- 

One verifies directly that Xn A G ii'^, and so the quantity above is less than or equal to 
dn — ^{"Vrixn) +v^{xm)) = 9n — \{9'n + grn)- Letting n and m go to infinity, it follows that for any 
Q > 0, P{A{n, m, a)) — > as n and m go to infinity. 

Given that K is itself bounded in probability by Lemma 14.41 it follows that the Xn are also 
bounded in probability, and from this fact and the above paragraph we deduce that the collection 
(xn) is indeed Cauchy in probability. Thus, there exists x ^ K which is the limit in probability of 
the (xn). We obtain almost sure convergence by passing to a subsequence. □ 

4.3. Nets and Convergence of Derivatives. When dealing with compact sets, e-nets are useful 
tools. In the less restrictive setting of convexly compact sets, we have to use different kinds of nets. 

Definition 4.10. Let K C LP{Fr), let /C = {ki, . . . , kn} be a finite collection of points in K, and 
let r > 0. We say that fC is a J^T^-convex r-net of K if for any x ^ K, there exists y G convj^^{lC) 
such that d{x, y) < r, where d is a distance function compatible with convergence in probability. 

Lemma 4.11. Let K C L'^(J>). Then for any r > 0, there is a finite J-r-convex r-net of K. 

Proof. Suppose to the contrary that such a net does not exist. This means that one can inductively 
construct a sequence (kn) in K such that for all n, d(/c„+i,y) > r for all y„ G conv_7r^(fci, . . . , kn). 
Since K is J>-convexly compact, take forward J>-convex combinations fn of the kn converging 
almost surely to /. This of course implies that as n — )• 00, d{fn+i, fn) — >• 0, a contradiction. □ 

Definition 4.12. Given a set K C L^{Tr) and K' C K , we define the Tr -po-ftition sub-convex 

hull of K' in K, denoted by convj- {K',K), to the be the set of Tr -partition subcombinations of 
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elements of K' in K. More precisely, it consists of elements of the form 

N 
n=l 

where N is an integer, {Ai, . . . , An} is an Tr-po-rtition of Q, and y„ G K such that y„ < k'^ for 
some k'n (z K' . 

Definition 4.13. Let K C , and let IC = {ki, . . . ,kn} be a finite collection of points in K, and 
let r > 0. We say that IC is a Fr-partition sub-convex r-net of K if for any x E K , there exists 
y G conv^^{}C, K) such that d{x,y) < r. 

Lemma 4.14. Let K C L^_,_(J-V). Then for any r > 0, there is a finite Tr-partition sub-convex 
r-net of K. 

Proof The proof is similar to the proof of Lemma 14.111 One needs to use the concept introduced 
in Proposition 14.91 in place of Jv-forward convex combinations. □ 

Proposition 4.15. Let K C L'^_|_(J>) be Tr-convexly compact. Then — > uniformly on K . 

Remark 4.16. In the classical proof of this result in with compact sets, one simply defines a 
standard e-net and goes from uniform convergence on that net to uniform convergence everywhere 
by virtue of an equicontinuity property. In this proof, the second part of the above argument is the 
same, but the first needs to be altered, because we need to ensure uniform convergence on a kind 
of convex hull, which has infinitely many points. Each of the nets described above gives one-sided 
inequalities for convergence in its respective "convex hull"; by combining the two nets, we can get 
uniform convergence. 

Proof. We have already shown that f " — )• v^ pointwise; see Proposition 13.111 In the rest of the 
proof we will upgrade the pointwise convergence to uniform convergence over K. Let e > be 
arbitrary but fixed. For this e, let 5 > be the the equi-continuity constant whose existence is 
implied by Corollarv 14. 8| that is, for any 01,02 € K, (i(oi,02) < 5 implies that 

max{(i(u^(oi),w^(o2)),d«(oi),<(o2))} < e. 

By the above two lemmas, we know that we can construct a finite J>-convex J-net of K and a 
finite Jy-partiton sub-convex J-net of K. By just taking the union of these sets, we will assume 
that there is a finite set IC = {ki, . . . , kg} that simultaneously is both of these types of nets. 

Given that IC is finite, we know that for n sufficiently large, d{v^{ki),v^{ki)) < | for all i. Let 
x € convjr^(/C), and write 

s s 

X = '^Qih, where y^gi = 1 

i=l i=l 

and each gi is Jv-measurable and between zero and one. By the J>-convexity of w", we have 

s 

(4.1) v!^{x)<Y,9^V^{k^). 

i=l 



26 

Let y G conv^^ (/C, ivT) be such that d(x,y) < S. This means that 

(4.2) maxH7;^(x),7;^(y)),(i«(x),<(y))} < e. 

Write y = J2i=i ^AiVi, where the Ai and yi satisfy the usual properties. By locality, 

s s 

(4.3) <(y) = lA.v^im) > UXih). 
We can establish the trivial inequalities 



(4.4) d \^^g,v'^{h),J2g,v^{k,)j <s- = e 
and 

(4.5) d [Y U.<(A;.), iZ ^A.vHk^)] <s- = e. 



a=i 1=1 



Combining (|4.ip — (|4.5p . we can conclude that d{v^ (x) , v!^ (x)) < 5e. 

Now we extend the result to all of K. For an arbitrary z £ K, choose x G convjr^(/C) such that 
d{x,z) < 6. Then the equicontinuity implies that d(f"(z), w^(z)) < 6e for n sufficiently large. □ 

Proposition 4.17. For all rj € L°_^(JV),& G L^i^r), «)'(r/;&) ^ (i'r)'(^;&) • 

Proof. Recall that a sequence of random variables converges in probability if and only if, for any 
e > 0, there exists a set of measure greater than 1 — e such that the random variables when restricted 
to this set converge in probability. Thus, by definition, it suffices to prove the result for b G L°°(J>) 
and r] bounded from below in L^^{Tr)- There exists e > such that X = {rj + f : |/| < e} is 
contained in L^_,_(J-V). Furthermore, the set X is Jv-convexly compact. For t G M with \t\ small 
enough, we know that rj + tb € X. The proposition is now a straightforward consequence of the 
uniform convergence established in Proposition 14.151 □ 

Proposition 4.18. For rj G L\^{Tr), {Vr)'{ri) {'"rYi'n)- 

Proof. This is a direct consequence of Proposition 14.171 since v^{r]; b) = b{v^y{r]). □ 

We may without any extra cost strengthen the above pointwise result into one of uniform con- 
vergence, using again Proposition I4.15[ 

Proposition 4.19. Let K C L*}_^(J>) he Fr-convexly compact. Then (f")'(r/) —> {v^)'{r]), uni- 
formly over all rj & K. 

The results on the dual side are also applicable to the primal value functions. We simply apply 
them to the J>-convex function —u^. 

Proposition 4.20. Let K C L^_^_{Tr) he Fr-convexly compact. Thenu^{£,) —> u'^{^) and{u^)'{£) —> 
(u:^)'(^) uniformly over all ^ G 
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5. From the Dual to the Primal 

5.1. Continuity of Value Functions. 

Proposition 5.1. The following four maps are continuous on L^_^_{J-r) x A'.' 

{71,X)^vHv), {^,\)^{v^nv), (e,A)^n^(6, and{C,X)^{u^rnO- 

Proof. We know the continuity of the first two functions with respect to A by Proposition 13. 11] and 
Proposition 14.181 

Obtaining continuity of the third and fourth functions with respect to A is done as in Proposition 
3.9 of 15J. Choose ^ G i++(^r) and e > 0, and define r/(e) = (u^)'(O + £• 

Since (f^)'(-) is strictly 

increasing 

hm «)'(7?(e)) = {v'^Yivie)) = (t;,^)'((n^)'(0 + e) > (t;,^)'((n^)'(e)) = 

n— f oo 

the last inequality following from the strict increase of (v^)', and the last equality following from 
the conjugacy of (v^)' and (u^)'. Consequently, for large n, we have — (f")'(r/(e)) < ^. Since (u^)' 
is strictly decreasing for each n G N, we have 

(n^)'(O + 6 = Me) = «)'(-«)'(r?(6))) > 

for large n, implying that limsup('u")'(^) < {u^)'{^). The other inequality, that liminf(M") > 

71— >oo n— )-oo 

{u^y{^), may be proven similarly, using — e in place of e. This gives continuity of {u^)' with respect 
to A. 

We establish the joint continuity for v^, using Proposition 14.151 Joint continuity for the other 
three mappings will be established in the same way, using Proposition 14.191 and Proposition I4.20[ 
Let (?7n,An) —5- (??,A). We want to show that f"(r/„) Vriv) probability. Hence, by passing to 
subsequences, it suffices to assume that rjn — > V almost surely. In this case, the set {r/„}„ U {rj} is 
Jv-convexly compact, because all forward Jv- convex combinations converge to r]. Hence, we apply 
Proposition 14.151 to get v^{r]*) — > v^{ri*) uniformly over all r]* G {?7n}n U {r/}, and the result now 
follows. □ 

5.2. Continuity of Terminal and Intermediate Wealths. We now give the proof of the second 
main theorem: 

Proof of Theorem 11.81 

Continuity of the first map is established in Lemma [5. 11 For the second part, by Theorem ll.9l the 
optimal terminal wealth X^^ G ^riO admits the representation, with rj = of U'{Xj^^) = 

r]Y^''^, where Y^''^ G solves the dual minimization problem. Thanks to the continuity of the 
mappings A) i-^ {u^y{^) and x — > {U')~^{x), it suffices to show that (ry. A) i-)- rjY^''^ is continuous. 
The proof, at this point, is done identically to Lemma 3.10 of [5], the main ingredients being the 
strict convexity of V and continuity of the dual value function. We refer the reader to [5] for details. 
□ 

We now lay the groundwork to prove Corollary 11.101 
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Lemma 5.2. Let Xi^'^ be the optimal terminal wealth for the market X, starting at wealth x. Then 
the process Ut = u^{X^''^) is a martingale. 

Proof. By definition, u^{x) = E[U{X^^)]. We argue that u^{X^'^) = E[U{X^'^) \ Tt], which is 
sufficent to prove that [/ is a martingale. Let t G [0, T]. By Theorem 11.91 there exists X € such 
that 

unX^'') = E[UiX^''XT)\Tt]. 

Suppose that 

E[U{X^'^) I Tt] + EpiX^^^Xr) I Tt]. 

Let ^4 E /"t be the set on whicli the first quantity is larger, and consider XL = l^^r^ + l^icX G . 

One then calculates that E[U{X^' X')] > E[U{Xi^' )]. This, however, contradicts the fact that X^' 
was optimal at time zero, since 

Lemma 5.3. Suppose that [xn, Xn) {x,X) appropriately. Then ^"(X^"'") — )• u^^X^''^) in the 
ucp (uniform convergence in probability) sense. 

Proof. By Lemma 15.21 the processes and u^{X^'''^) are all martingales. By Lemma 11.71 

= ^ [7(1^'^) = u^{X^'^). Applying the weak form of Doob's LP inequality 

for p = 1, we deduce ucp convergence. □ 

Note that for the problem here, we only need pointwise convergence at each stopping time r. The 
stronger result given above would be appropriate for a setting in which the goal was ucp convergence 
of the optimal wealth processes. This is the topic of our next paper. 

Proof of Corollary 11.101 Let (x„,A„) ix,X). By Lemma 15.31 for stopping time r, we 
have <(X^"'") ^ u^{Xr' ) in probability. By the reasoning given in Proposition 15.11 (namely that 
continuous strictly increasing functions have continuous inverses), the mapping (C, A) i-^ 
is continuous. We conclude that X-f"'" — >■ X^'"^ in probability. □ 

Appendix A. A Conditional Minimax Theorem 

In this section, we prove a conditional version of the Minimax Theorem from convex analysis. It 
is used to establish the dual relationship between and v^. We let Q be an arbitrary sub sigma 
algebra of J-. In applying the results of this section, it will always be the case that G = J~t for some 
stopping time r. 

Let X be a bounded, cr(L°°, L^)-compact, ^-convex subset of L^, and let y be a closed, ^-convex, 
bounded subset of L^. Let K : X xY L^{Q) be the map defined by K{x^ y) = E[U (x) — xy \ Q\. 
In this section we prove the following conditional minimax theorem: 

Proposition A.l. ess sup essinf K(x,y) = essinf ess sup K(x,y) 
x(zx y& y& x&x 

The strategy will be to reduce to the unconditional case. As usual, the " <" direction is trivial, 
so we prove this first. For any y and x € X, we trivially have essinf K{x, y) < ess sup K{x, y). 
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We then take the supremum over all x on the left hand side and the infimum over all y on the right 

hand side, giving the desired inequality. 

As in the unconditional case, the " >" inequality is the difficult one. Suppose for contradiction 

that ess sup essinf K{x,y) < essinf ess sup K{x,y) on a set of positive measure. Then there exists 

xex y& y& xex 

an e > and a set A G ^ with P{A) > such that 

ess sup essinf K{x,y) < —sIa + essinf ess sup K{x,y). 
xex y&" xex 



Taking expectations of both sides, we have the inequality 



E 



ess sup essinf K{x,y) 
a;ex y^Y 



< -eP{A) + E 



essinf ess sup K{x,y) 
. y^Y j.gj5f 



What we want to do now is interchange the expectation with the essential supremum and essential 
infimums on each side. We treat the left hand side. First, it is obvious by the definition of essential 
supremum that 



E 



ess sup essinf K{x,y) 
. xex y^y 



> sup E 
xex 



ess inf K{x, y) 
yeY 



Lemma A. 2. The set {K{x,y) : y G Y} is downwards directed for all x E X. 

Proof. Fix X e X. Let yi,y2 G Y, and let B = {K{x,yi) < K{x,y2)} € Q. By the ^-convexity 
of y, y = IbVi + lBcy2 S Y. Then it is immediate that K{x,y) = {lBK{x,yi) + lB<:K{x,y2)) = 
K{x, yi) A K{x, 7/2)- Thus, the set in question is downwards directed. □ 

By the properties of essential supremum, it follows that for each x G X, there exist y„ = yn{x) G 

Y such that K{x,yn{x)) 4 essinf K{x,y). So, for fixed x, we have, by Monotone Convergence, 

yeY 



E 



essinf K{x,y) 
yeY 



E 



lim K{x,yn) 



= lim E[Kix,yn)] > m{ E[K{x,y)]. 

yeY 



We can thus conclude that 



sup inf E[K{x, y)] < E 
xex 2/ey 



ess sup ess inf K{x, y) 
. xex 2/ey 



We now treat the right hand side in a similar manner. As before, by the definition of essential 
supremum, 

E 



essinf ess sup K(x,y) 

y& xex 



< inf E 

yeY 



ess sup K(x, y) 

xex 



This next lemma is proved identically to the one appearing above. 
Lemma A. 3. The set {K{x,y) : x G X} is upwards directed for all y eY. 
We continue precisely as before to eventually obtain this inequality: 
E 



ess inf ess sup K{x, y) 
. y^Y 



< inf sup £'[K(a;, y)]. 
y^Y j.gj5f 
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We combine the two derived inequalities to obtain 
(A.l) sup inf E[K{x, y)] < -eP{A) + inf sup E[K{x, y)]. 

We are now in a position to obtain a contradiction by applying the unconditional minimax theorem. 
Following the argument presented on p. 13 of we have, using the classical minimax theorem, 
that 

(A. 2) sup \ni E\U {x) — xy\ = inf sup£'[C/(x) — xy]. 

x<^X yeY ^(zx 

Combining (lA.ip and ()A.2p . we obtain the desired contradiction. This establishes the conditional 
minimax theorem. 
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